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ABSTRACT 

An extensive literature exists on what makes good 
teachers, focusing on their characteristics, their behaviors in the 
classroom, and the effects they have on their students. This 
literature points to three groups as being currently involved in 
defining good teachers: students, who, as research demonstrates, are 
reliable observers, fair and unbiased raters, and capable of 
describing the characteristics and behaviors of good teachers; 
external judges assessing student outcomes as the measure of 
educational effectiveness; and educational researchers, who through 
their counting, observing, experimenting, and surveying, attempt to 
provide generalizable definitions and criteria for teaching 
effectiveness. The literature on criteria for evaluating the quality 
of instruction is deficient in several areas, lacking good discussion 
of what teachers are trying to accomplish, a constructive approach to 
applying research to the improvement of practice, and a body of 
information on how to conduct research in the classroom. The most 
useful approach to filling these gaps in the literature, while at the 
same time improving undergraduate instruction, involves teachers 
doing research in their own classrooms and learning laboratories as a 
means of evaluating their effectiveness as teachers while fostering 
intellectual stimulation and professional renewal. Examples of the 
kinds of classroom research projects that might be undertaken include 
an investigation of the dropout problem, whether review sessions 
before exams promote long-term retention, or whether particular 
teaching methods are effective. While these kinds of projects do not 
generally call for complicated research methodologies, they should 
use acceptable standards of research practice if they are to have 
value in improving classroom teaching. (LAL) 
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IMPROVING LEARNING IN COMMUNITY COLLEGES 



K. Patricia Cross 
Harvard Graduate School of Education 

It always gives me a boost to meet with representatives 
of League colleges because I feel that I am on the cutting edge 
of change in higher education when I meet with you. There is an 
excitement about the educational challenges that become your 
daily fare. This conference with computers as the theme, is one 
more example of your desire to operate on the cutting edge in 
education. 

Since about the 1960s, most of the major trends in 
higher education have started in community colleges and then 
moved to the rest of higher education. The examples are easy to 
cite. Community colleges were the first to deal effectively with 
the influx of underprepared students to higher education. 
Adult, part-time students constituted another wave of new stu- 
dents to higher education, and community colleges responded with 
new programs and new flexibilities regarding the time and place 
of education. America's new and old immigrants make their way 
into American society largely through community colleges. 



Presented at the League for Innovation Conference, Miami, Flo- 
rida, October 8, 1986. Appreciation is expressed to Harvard Uni- 
versity and to NCRIPTAL, University of Michigan, for funds to 
support work on classroom research. 
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Kost of the recommendations have to do with what is taught, i.e. 
the curriculum. Some seem to think that is where the problem 
lies— that students dan»t learn what they should learn in col- 
lege. I am inclined to think, however, that how students are 
taught is even more critical, what is taught is important, but 
how it is taught makes the difference between a lifelong learner 
and a grade grubber, between enthusiasm for learning and indif- 
ference to it, between an educated society and a credent ialed 
one. 

Our educational system is based on the belief that some- 
thing important happens when teachers meet students in the class- 
room, machine shop, or learning lab. Most of any institution's 
budget is allocated to costs of instruction, and yet instruction 
receives very little attention from college administrators— not 
because we don't think it is important, but because we don't 
quite know what to do about a number of things. College teach- 
ers, for instance, are authorities in their specialties. No one 
else at the institution knows quite as much about their particu- 
lar specialties aa they do, so there is an understandable reluc- 
tance to tell faculty what or how to teach. Moreover, we in 
higher education equate academic freedom with the sanctity of the 
classroom, and there is a tradition of restraint in probing too 
deeply what goes on there. And finally, there are a set of age- 
old questions that have not been answered to the satisfaction of 
many— What constitutes effective teaching? who should evaluate 
college teachers and how? Can the multiple forms of good teaching 
be recognized and appropriately rewarded? 

Those are good questions, and they are questions that 
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are especially important to so-called teaching institutions, I 
think all colleges and universities are, or should be, teaching 
institutions, but my concern today is with those institutions 
where the job definition is unambiguous for faculty members. 
They are teachers first, and if they don't do that well, there is 
no place else to hide. 

Most of us believe that the quality of student learning 
depends in large measure on the quality of instruction. And most 
people — at least those who write reports and make state policy — 
believe that if the rewards for good teaching were greater the 
teaching would be better. Without denying that greater rewards, 
more attention, and more value placed on teaching would 
undoubtedly help, it is by no means certain that we really know 
what to do to improve teaching. The notion that greater rewards 
will improve teaching assumes that faculty know how to teach 
well, but are not doing so because there are other things more 
rewarding. 

I am going, to assume, for the purposes of getting this 
discussion off the ground this morning, that this is an ideal 
world, and that good teaching will be appropriately rewarded. 
Now what? 

First we have to deci /hat good teaching is. We are 
not exactly novices in discussing and researching that question. 
There is an extensive literature on research and various people's 
notions about what makes a good teacher. Basically, there are 
three ways to describe effective teachers: 1) We can describe 
their characteristics — training, experience, and knowledge of 
subject matter, 2) We can describe their behaviors in the class- 
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room—Whether they ask provocative questions, call students by 
name, and encourage discussion, and 3) we can describe what stu- 
dents are able to do as a result of the teacher's efforts— how 
much they know, how well they think, their attitudes toward 
learning, etc. In short, the literature consists of descrip- 
tions of input, process, and output variables. The criterion 
problem is present, of course, in all of these approaches. In 
order to describe what a good teacher is, or does, or accom- 
plishes, we need to know how we are defining a "good" teacher. A 
little reading of the literature on this issue quickly drives one 
to paraphrase the Supreme Court justice commenting on pornogra- 
phy, "I can't define good teaching, but I know it when I see it." 

Well, maybe that is not such a bad position to take. 
All of us can identify good and poor teachers on our own cam- 
puses, and when researchers go onto a campus and start asking 
students, faculty, and administrators to identify the best teach- 
ers on campus, it doesn't take long to come up with a list that 
shows rather high agreement. 

Much of the agreement, of course, comes from the heresay 
of student comments on teachers and courses. In recent years, 
the "heresay" has been formalized into systematic student rat- 
ings, and student evaluations of teaching have been widely 
adopted nationwide. To the credit of higher education, the use 
of student ratings increased in proportion to the positive find- 
ings from research on the reliability and validity of student 
evaluations. Although researchers can still manage to raise new 
questions and reservations, I think the judgment is fairly well 
in by now. Students are reliable observers; they have ample 
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opportunity to see teachers in action on good days and bad, and 
they are in a good position to evaluate the impact of the teach- 
ing on themselves as learners. 

Moreover, the evidence suggests that student ratings 
have good validity, i.e. that students tend to rate most highly 
those courses in which they learn the most. Centra (1977) found 
correlations in the .60s and .70s between scores on final exams 
and student ratings of "overall teaching effectiveness" and 
"value of the course." While one can still find reported corre- 
lations ranging from negative to high positive, the tilt of com- 
prehensive, well-designed studies — and he more recent meta- 
analyses (Cohen, 1982) — is clearly toward significant positive 
correlations between student achievement and positive course rat- 
ings . 

Another test of the validity of student rati'\,3 is to 
relate student ratings to teacher behaviors in the classroom. 
Murray (1985) found that teachers who received high student rat- 
ings did, according, to neutral classroom observers, teach differ- 
ently from teachers receiving low ratings. Highly rated teachers 
were well-organized, expressive, lucid, interacted more with stu- 
dents, related subject matter to student interests and in general 
demonstrated the same classroom behaviors that students report 
for good teachers (Erdle and Murray, 1986) . 

Students also tend to be reliable and relatively 
unbiased raters. There is no evidence to support the myths that 
popular teachers are mere showmen, that the mature perspective of 
alxamni will find virtues in the professors that were not 
respected ten years earlier, that teachers who are tough graders 
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will receive low ratings, or that agreement on the identity of 
good teachers is difficult to achieve (Gaff and Wilson, 1971) . 

One answer to those who are ready to reward good teach- 
ing if it can be identified is that students know good teaching 
when they see it. But students can go further; they can describe 
the characteristics and behaviors of good teachers. The 
research, by this time, is fairly consistent on what students 
consider important factors in effective teaching. Feldman (1976) 
reviewed a group of studies in which students were asked to 
describe "good" or "ideal" or "best" teachers. He found eight 
characteristics that were usually ranked high in all studies: 
concern for students, knowledge of subject matter, stimulation of 
interest, availability, encouragement of discussion, ability to 
explain clearly, enthusiasm, and preparation. There is nothing 
at all surprising about his findings. These characteristics turn 
up over and over again in one form or another when students are 
asked to describe good teachers. 

Factor analytic studies of student rating forms show 
rather similar clusters of characteristics. Feldman (1976) 
reviewed nearly 60 factor analytic studies and concluded that 
there were three major clusters in effective teaching — the 
instructor's ability to present the material, to encourage stu- 
dents to learn, and to regulate and deal fairly with students. 
Kulik and McKeachie (1975) reviewed eleven factor analytic 
studies of teacher rating scales and found similar factors which 
they labeled as follows: "Skill," which represents the ability to 
communicate in an interesting way, to stimulate intellectual 
curiosity, and to explain clearly, "Rapport" which involves 
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empathy, interaction with and concern for studants, "Structure" 
which concerns organization and presentation of course material, 
and "Overload" which refers to the workload and instructor 
demands (Abrami, 1985) . 

I find all of this quite credible, and I have no diffi- 
culty believing that teachers who have these characteristics, not 
only rate high with students, but probably are good teachers. 
Since student evaluations are far and away the most common form 
of teacher evaluation at the college level, teacher effectiveness 
is currently being defined and determined by a combination of 
researchers, who decide which items should go into the rating 
scales, and by students who decide which items will be important. 

The next five years will probably see the rapid growth 
of another set of judges and definers of good teaching. The 
assessment of student learning movement — for surely it can be 
called "a movement" now—purports to use student outcomes as the 
measure of educational effectiveness. At worst, this will put 
the definition and reward of good teaching in the hands of exter- 
nal agencies who will decide what students should know and how it 
is to be measured. At best, it will call attention to the goals 
of instruction and how well they are being accomplished, state- 
wide testing of student achievement is certainly on the increase, 
and while it is quite unlikely to determine an individual 
teacher's future, it is possible that teachers will be encouraged 
to "teach to the test." if the test really measures what stu- 
dents should learn in college, that may not be all bad, but few 
have that much confidence in our current measures of learning. 

The assessment movement underway now has ambitious goals 
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but quite modest accomplishments. Almost everyone would like to 
measure a wide range of student outcomes, affective as well as 
cognitive, to develop in teachers the insight and motivation for 
instructional self-improvement, and to integrate assessment into 
the instructional process. However, what we have to date in most 
places is the measurement of a narrow band of fairly low-level 
cognitive skills. While the current practices seem a long way 
from the ideal, the search for better measures must be under- 
taken. Assessment is the first step to imj movement. 

Yet a third set of judges of the criteria for teaching 
effectiveness are educational researchers. Educational 
researchers go about determining teacher effectiveness in a vari- 
ety of ways. They count; they observe; they conduct experiments; 
they write ethnographic or naturalistic descriptions; they survey 
other people. While some would claim that researchers don't 
determine the criteria for teaching effectiveness and that their 
task is to describe what exists without imposing their own values 
on the data, that is not what really happens. 

The major value that researchers impose on the search 
for criteria of teaching effectiveness is that the findings must 
be generalizable, that is to say, not specific to any particular 
classroom. The methods of traditional social science research — 
sampling, tests for significance, control of variables, and the 
like— are devised largely to prune out situation-specific influ- 
ences, leaving those characteristics common to all or most effec- 
tive teachers. Yet, some of the most effective teachers any of 
us can remember were effective because their unique characteris- 
tics worked in very specific situations. The search for criteria 
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for teaching effectiveness that has been conducted with consider- 
able energy and earnestness by researchers over the past decade 
is helpful in showing us what effective teachers have in common, 
but it masks some of the most useful information, specifically 
any insight into how individuals with their infinite variety and 
unique values and interests develop into effective teachers in a 
situation-specific classroom. 

I have taken some time to review the current status of 
research on the criteria for evaluating the quality of instruc- 
tion because I want now to talk about what's missing and how we 
can find it and apply it to the improvement of undergraduate 
instruction. 

The first thing that is missing from the literature is 
some good discussion of what teachers are trying to accomplish. 
Students, legislators, and researchers all have entrees to defin- 
ing the criteria for good teaching. But, in my survey of some 
200 articles and books on college teaching, I came across only 
two studies that asked teachers what they wanted students to 
learn from them. -True, teachers serve on committees to develop 
achievement tests; they serve on curriculum committees; they are 
frequently polled regarding hours spent in class preparation, 
perceived rewards for teaching, and attitudes about the policies 
of their institutions. But they are rarely asked what they are 
trying to do in their own classrooms. 

A classic study by Axelrod (1976) found that even among 
the relatively homogeneous population of humanities teachers in 
4-year colleges, teachers were aiming for vastly different out- 
comes. Some taught to the goal of mastery of svOsject matter. 
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fom« worked to holp ttudonts develop higher level cognitive 
•kills eueh eyntheeie, antlyiii, and evaluation, sone were 
■ore interested in the personal development of their students, 
while others tried to aodel for their students the well-educated 
aind at work. 

Studies of teaching goals in community colleges would 
probably reveal additional goals, some teachers are trying to 
teach job-entry skills, some have the building of self-confidence 
and self-respect as their first priority, some feel strongly 
that the greatest service they can render is to see that students 
learn the basic skills of communication. 

The first etep then, z should think, in improving under- 
graduate instruction is to find out what teachers are trying to 
do. If that is not what they should be doing or if their aspira- 
tions are not high enough, that's one thing. But if they do not 
or cannot accomplish the goals they set for themselves, then that 
is a different problem. 

The second, element that is missing from the literature 
on effective teaching is a constructive approach to applying 
research to improve practice. I specify "constructive approach" 
because, over the years, there has been criticism of practition- 
ers for their failure to use research, on the one hand, and cri- 
ticism of researchers to work on useful questions, on the other. 
But I think the gap between research and practice is the fault of 
neither. 

Social science research, with its search for general 
truths that hold across all classrooms, is not designed to 
address the situation-specific questions that teachers have. 
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What a teacher needs to know Is how his or her behavior affects 
the learning of a known group of students, studying a specific 
learning topic, under known conditions. Few researchers can 
afford to produce such custom-designed research. By and large, 
the purpose of educational research is to push back the frontiers 
of knowledge and to build the foundations for understanding. It 
is to improve the practice of education writ large, but so far it 
has done little to improve classroom teaching. John Dewey (1929, 
p. 19) wrote almost sixty years ago that, "no conclusion of scien- 
tific research can be converted into an .immediate rule of educa- 
tional art." That wisdom still holds true today (Fenstermacher, 
1982) . 

Donald Schon (1983) contends in his new and provocative 
little book entitled The Reflective Practitioner that research 
has done little to improve practice in any of the professions. 
In fact, he says, universities pursue "a view of knowledge that 
fosters selective inattention to practical competence and profes- 
sional artistry" (p, vii) . He calls for us to put aside the 
notion that "inteLligent practice is an apialicatlon of knowledge 
to instrumental decisions" (p. 50) and instead to help profession- 
als gain insight into their practice through an ongoing process 
of reflecting on what they know and articulating their intuitive 
thinking. 

While it seems to me that Schon 's reflection-in-action 
offers helpful new perspectives on the use of knowledge to 
improve practice, I continue to think it is both possible and 
desirable for teachers to collect and use both "hard" and "soft" 
data on what students are learning in their classrooms. I call 
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this classroom research. Research designed for the improvement 
of teaching should be conducted in real classrooms or learning 
laboratories, and it should provide immediate and useful feedback 
on what students are learning, computers are proving of enormous 
value in providing data on student learning, not only in large- 
scale assessment projects, but most importantly while learning is 
in process with students at the keyboard. 

Classroom research may, at first blush, appear to result 
in knowledge with extremely limited usefulness to the profession 
of teaching, but my guess is that the exchange of knowledge from 
many specific classrooms will give teachers more useful insight 
into the teaching/learning process than the search for general- 
izations across a "representative sample" of students, teachers, 
and stibject matters, in any event, I think it highly likely that 
the knowledge gained from doing research is more likely to be 
used than that gained from reading about research. 

The third thing that is missing is a literature on how 
to conduct research- in and on the classroom, with its inevitable 
variations in teachers, students, and subject matter. An articu- 
late group of critics of traditional educational research is 
beginning to be heard promoting various alternatives, such as 
ethnographic research, naturalistic inquiry, action research, 
qualitative methods, and reflective practice (See, for examples, 
Cuba, 1979; Cuba and Lincoln, 1981; Eisner, 1980, 1984; Argyris, 
et al . 1985; Schon, 1983; Stiggins, 1985). This is a scattered 
but promising development, one that should add valuable perspec- 
tives to the search for knowledge about teaching and" learning. 

But naturalistic inquiry, ethnographic research, and the 
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other new alternatives to quantitative, experimental research, 
for all their value— and it is considerable— are not the answer 
to a research approach to the improvement of teaching either. 
Many of their rules and conventions are no more applicable to the 
improvement of classroom practices than those of quantitative and 
experimental research. Naturalistic evaluation, for example, 
requires "lengthy and prolonged" engagement by a highly trained 
researcher (Williams, 1986) , and part of the value of ethnography 
comes from the notion that findings should "evolve" from the 
study rather than be interpreted as "answers" to questions formu- 
lated by researchers (Smith, 1982) . 

Perhaps we could simply work harder and write more (per- 
ish the thought) to fill in the missing pieces that I have iden- 
tified from my review of the literature on effective teaching, 
but I suggest that it is time to develop a different approach, 
specifically designed for what we want to accomplish, namely, the 
improvement of instruction. I am convinced that the most useful 
research will be done by teachers themselves in their own class- 
rooms and learning- laboratories. The purpose of classroom 
research is to help the teacher evaluate his or her effectiveness 
as a teacher and to foster intellectual stimulation and profes- 
sional renewal for college teachers. The concept of classroom 
research springs from six basic assumptions: 

1) That the quality of student learning is 
directly related to the quality of instruction. 

2) That teachers need to know what their 
students are learning in their classrooms. 

3) That inquiry and intellectual challenge 

are sources of professional renewal for teachers. 
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4) That the research most likely to improve 
instruction is that conducted by classroom teachers 
formulating and investigating questions that they 
want answered. 

5) That self -improvement is most likely to result 
from specific feedback relevant to one's own goals and 
behaviors. 

6) That there is nothing so mysterious or esoteric 
about research on college teaching that it cannot be 
done by anyone capable of teaching at the college 
level . 

I suggest that the implementation of classroom research 
should begin with experienced teachers in the field, but I also 
think that every graduate student planning to teach any subject 
in any college should demonstrate competency in conducting inves- 
tigations into the effectiveness of his or her own teaching. New 
graduate courses need to be designed, new methods devised, new 
perspectives developed. Let me give some concrete examples of 
what some possible classroom research projects might look like. 

First, I would like to give an example of the contrast 
between how a classroom researcher and a traditionally trained 
researcher might approach a similar problem. Let us assume that 
the problem is the familiar one of dropouts, in the traditional 
studies of dropouts that we all know so well, the researcher 
selects representative samples of dropouts and persisters, and 
after collecting data from student records, determines the dif- 
ferences between persisters and dropouts, inevitably concluding 
that dropouts come from lower socioeconomic backgrounds, made 
lower grades in high school, work more hours off campus, are com- 
muters, and have lower educational expectations. 
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While these findings are verified so frequently by 
rese..j-chers that we have to conclude that they are indeed factors 
in dropping out of college, all of the factors identified are 
what Ben Bloom (1980) would call "unalterable variables." There 
is nothing that educators can do to change them. 

Now let us see how a classroom researcher might study 
this problem. Let us assume that our classroom researcher is 
curious about the dropout problem, decides to interview some stu- 
dents who stopped coming to class, and finds out that a certain 
amount of discouragement sets in as the semester's work begins to 
build. As she reflects on this observation, it occurs to her that 
she usually hits her stride as a teacher about the fifth week of 
the semester and feels ready to tackle some of the more difficult 
units about that time. She notes that the high dropout in her 
own classes occurs about five weeks into the school year, and she 
concludes that she might try a number of things in her own class- 
room to reduce needless dropouts— perhaps give an especially sat- 
isfying assignment, -maybe rework or reschedule the difficult 
unit, maybe call in a few students and talk with them about the 
unit or about the class, perhaps offer special encouragement, 
make a referral, drop a note, make a call. 

The procedure of the classroom researcher is to formu- 
late the question, collect data, reflect on classroom practices, 
try a solution, and evaluate the results. A graduate level 
course in classroom research might consist of some work on how to 
get the most information from classroom tests, how to design 
course evaluations, how to create and use quick feedback devices 
for determining the effect of various teaching approaches, how to 
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use panels of students to understand class reactions, how to 
interview, how to use holistic analyses for written work and 
other research techniques designed to provide feedback to teach- 
ers on what students are learning. Computers used in the 
instructional process ar-^ goldmines of information about student 
learning processes. But teachers must learn to use this informa- 
tion to shape instruction. 

Faculty meetings might consist of groups of classroom 
researchers and might well be planned around classroom research 
projects to share data, perceptions, and possible solutions. The 
emphasis in faculty meetings should be on the use of data and 
systematic observation; discussion might appropriately range from 
sharing useful and creative approaches to gathering data, to data 
analysis, to recommendations for possible changes in policies and 
practices within the department, one of the important side 
effects of classroom research is that it has the potential for 
adding professional stimulation to faculty meetings. 

I cite this example of a department-wide project to show 
that classroom research need not be a solitary activity. The 
questions raised in classroom research may be shared with a vari- 
ety of others— departmental colleagues, the faculty of a college, 
disciplinary peers nationwide, or any other group of educators 
with a common question. 

At the same time, classroom research is appropriate to 
the study of a unique problem occurring in an individual class- 
room—or perhaps it is not a "problem" at all, but rather a 
matter of curiosity to the teacher. Examples of this sort of 
project are n'omerous. Perhaps the teacher wants to know whether 
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a "review session" prior to the mid-term helps in long-term 
retention or is only useful for immediate test score gains. Or 
perhaps the teacher is interested in knowing whether a field trip 
is wor...'\ the effort in changing attitirdes about a particular 
social problem— or would reading about it or discussing it or 
seeing a dramatization on videotape do as well or better? Maybe 
a math teacher, interested in teaching a particular math concept, 
reads about another teacher's method and decides to test it in 
his own classroom. 

The projects for classroom research are limited only by 
teachers' imaginations. While the examples I have presented do 
not generally call for complicated methodologies or analyses, 
there is nothing to prevent interested teachers from studying 
very complex learning problems. Mina Shaughnessy ' s (1977) con- 
tribution to the improvement of student writing was arrived at 
through sitting down with hundreds of beginning writers and sen- 
sitively observing individual struggles with the writing process. 

In conclusion, l think it is time to get classroom 
teachers directly -involved in the study of teaching and learning. 
They should be intellectually curious about it as well as profes- 
sionally involved in the improvement of their own teaching prac- 
tices. While classroom research can be done now by any teacher 
with the appropriate curiosity and motivation, I believe that if 
classroom research is to help all of us, there should be stan- 
dards for the quality of the research. We have come a long way 
over the past fifty years, and there is much that we have learned 
about the stui^y of human behavior. My plea is not to ignore uni- 
versity-based research on teaching and learning, but to build a 
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new science of classroom research on the foundation of what we 
now know about research methods and application— with the impor- 
tant caution that we keep classroom research true to its own pur- 
poses, namely improving the practice of classroom teaching, it 
should be done by teachers in teaching institutions. 

It seems to me that the mission and reputation of League 
colleges puts you in an ideal position to take the leadership in 
training your teaching faculty to do classroom research. I hope 
you will. 
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